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(54) IMAGE MONITORING DEVICE 

(57)Abstract: 

PROBLEM TO BE SOLVED: To solve the problem that a conventional method can not 
follow a dynamic change such as a sunlight condition of an area to be monitored, 
resulting in false detection and failure in detection of an intruding object. 
SOLUTION: An object which moves fast is detected on the basis of a rapidly updated 
luminance difference between a reference image and a monitored Image, an object 
which moves at a low speed is detected by using an averaging monitored image, and 
an object which is silhouetted by a silhouette object detecting means is detected 
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when a reflected state is discriminated by an environment analyzing means. 
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CLAIMS 



[Claim(s)] 

[Claim 1] The image supervisory equipment carry out providing an image input means, 
two or more body detection means according to passing speed, a detection body 
selection means unify the detection result by two or more of said body detection 
technique, a body trace means pursue the body sorted out by said detection body 
selection means over a multiple frame, and an invasion body Judging means Judge it as 
detection of an invasion body when it is able to pursue with said body trace means 
beyond a predetermined distance as the description. 

[Claim 2] An image input means, two or more body detection means according to 
passing speed, and a silhouette body detection means to detect a silhouette-like body, 
A detection body selection means to unify the detection result by said two or more 



body detection means and the silhouette body detection nneans. Innage supervisory 
equipment characterized by providing a body trace means to pursue the body sorted 
out by said detection body selection means over a multiple frame, and an invasion 
body judging means to judge it as detection of an invasion body when it is able to 
pursue with said body trace means beyond a predetermined distance. 
[Claim 3] An image input means, a body detection means to detect a non-silhouette 
body, and a silhouette body detection means to detect a silhouette-like body, A 
detection body selection means to unify the detection result by said body detection 
means and the silhouette body detection means. Image supervisory equipment 
characterized by providing a body trace means to pursue the body sorted out by said 
detection body selection means over a multiple frame, and an invasion body judging 
means to judge it as detection of an invasion body when it is able to pursue with said 
body trace means beyond a predetermined distance. 

[Claim 4] Image supervisory equipment characterized by establishing an 
environmental analysis means and sorting out with said detection body selection 
means in claim 1 thru/or any 1 term of 3 according to the analysis result of said 
environmental analysis means. 

[Claim 5] It is image supervisory equipment characterized by displaying the analysis 
result of said environmental analysis means in claim 4. 

[Claim 6] It is image supervisory equipment characterized by displaying the sorting 
condition of said detection body selection means in claim 4. 

[Claim 7] Image supervisory equipment characterized by a hitcher on operating and 
sorting out said detection body selection means in claim 1 thru/or any 1 term of 6. 
[Claim 8] The image supervisory equipment which carries out [ having an amount 
measurement means of fluctuation measure brightness change of the background 
image of a monitor field, an invasion body detection means bring about the brightness 
change beyond the measurement brightness change by said fluctuation measurement 
means, and an invasion body detection means bring about the brightness change 
below the measurement brightness change by said fluctuation measurement means in 
claim 1 thru/or any 1 term of 7. and ] as the description. 

[Claim 9] An amount measurement means of fluctuation to measure the amount of 
fluctuation of the background image of a monitor field in claim 8, A fluctuation image 
creation means to create the criteria image containing fluctuation which updated 
quickly and was created in order to incorporate the fluctuation below the amount of 
measurement fluctuation by said amount measurement means of fluctuation. Image 
supervisory equipment characterized by the high speed which consists of the body 
detection means considered as body detection with detection of a field with the 
brightness difference of said criteria image containing fluctuation and monitor image, 
and usually providing the mobile detection means of a rate. 

[Claim 10] Image supervisory equipment characterized by making into an invalid a 



body detection means to detect the invasion body which brings about the brightness 
change beyond the measurement brightness change by said fluctuation measurement 
means to the field which measures brightness fluctuation of the background image in a 
monitor field, and is changed in claims 8 or 9 more sharply than predetermined 
brightness fluctuation. 

[Claim 11] The image supervisory equipment which has the body detection means 
which considers as body detection in claim 4 thru/or any 1 term of 1 0 with detection 
of the field which has the change beyond a predetermined brightness difference to the 
criteria image of a monitor field, and is characterized by to abandon a trace by making 
into a noise the detection body with which the predetermined magnitude after 
measuring the magnitude of a detection body does not fill in said body detection 
means. 

[Claim 12] Image supervisory equipment with which counting of the number of the 
noise generated with said body detection means is carried out in claim 11, and said 
body detection means is characterized by providing an environmental analysis means 
to judge whether it is operating under the environment which is [ incorrect-] easy to 
detect. 

[Claim 1 3] the number of the noise generated in claim 1 2 with the body detection 
means by different technique, and the body detection means by said different 
technique — said every body detection means — counting — carrying out — said 
counting — the image supervisory equipment characterized by providing an 
environmental analysis means to judge from a result the body detection technique of 
having been suitable for the present environment. 

[Claim 1 4] Image supervisory equipment characterized by providing the low speed and 
the halt body detection means which the degree of spatial change of brightness uses 
the field more than predetermined magnitude as an invasion body in claim 1 thru/or 
any 1 term of 1 3 by the monitor image which carried out the brightness average of 
several frames of a monitor field for every pixel. 

[Claim 15] Image supervisory equipment characterized by providing the low speed and 
the halt body detection means which have the criteria image which averages and 
creates the time series image of a monitor field for every pixel over a multiple frame in 
claim 14, and the degree of spatial change of brightness appoints the field more than 
predetermined magnitude at an invasion body detection invalid field by said criteria 
image. 

[Claim 16] Image supervisory equipment characterized by providing the low speed and 
the halt body detection means of creating said criteria image for every fixed time 
amount, in claim 15. 

[Claim 17] Image supervisory equipment characterized by providing the silhouette 
body detection means which will make this an invasion body if the averaging image 
which carried out averaging of the time series image of a monitor field is held in claim 



1 thru/or any 1 term of 1 6 and the field below the second predetermined brightness is 
detected to the field more than the predetermined brightness in said averaging image. 
[Claim 18] In claim 17, the field more than said predetermined brightness of said 
averaging image is received. When an invasion body does not exist, detect the field 
below the second predetermined brightness, create the binary picture of this field and 
fields other than this, and said binary picture is held as a criteria image. Image 
supervisory equipment characterized by providing the silhouette body detection 
means which makes the field below said second predetermined brightness an invasion 
body detection invalid field by said binary picture. 

[Claim 1 9] Image supervisory equipment characterized by providing a silhouette body 
detection means to create said criteria image periodically, in claim 18. 
[Claim 20] Image supervisory equipment which collates the body detected for every 
frame by inter-frame in claim 1 thru/or any 1 term of 19, makes a movement vector 
the migration direction and magnitude of this body inter-frame [ said ]. and is 
characterized by providing a body trace means to choose the part which is based on 
the magnitude of said movement vector and represents the location of said body at 
the time of next inter-frame collating. 

[Claim 21] In claim 20 in below magnitude predetermined in said movement vector The 
core of the circumscription rectangle of the body at the time of inter-frame collating 
is made into the representation location of said body. It is image supervisory 
equipment characterized by providing the body trace means which makes an 
intersection with the profile of the segment lengthened in said direction of a 
movement vector from the circumscription rectangle core of said body when said 
movement vector was larger than predetermined magnitude, and said body, or the 
profile of said circumscription rectangle the representation location of said body. 
[Claim 22] Image supervisory equipment characterized by consisting of computers 
equipped with the image input interface and the image display interface in claim 1 
thru/or any 1 term of 21. 

[Claim 23] Image supervisory equipment characterized by using an infrared camera as 
a TV camera in claim 1 thru/or any 1 term of 22. 

[Claim 24] Image supervisory equipment characterized by having infrared irradiation 
equipment in claim 23. 



DETAILED DESCRIPTION 



[Detailed Description of the Invention] 
[0001] 

[Field of the Invention] This invention relates to the image supervisory equipment 



which detects a motion of an invasion body alternatively and reports it in a scene with 
motions, such as a scene which starts the image supervisory equipment which 
detects and supervises a monitor object in a background with a motion, especially has 
motions, such as a wave of the water surface, and reflection, and fluctuation of trees. 
[0002] 

[Description of the Prior Art] As image supervisory equipment, if an invasion body is 
detected in a monitor object domain, much equipments which report existence of an 
invasion body to a hitcher on are introduced. As conventional image supervisory 
equipment, there are a camera with a preset feature, an infrared sensor, a monitor, 
and image supervisory equipment that consists of image transcription equipment, for 
example. 

[0003] The camera with a preset feature is a TV camera which can control the sense 
and dilation ratio of a field angle, and is a camera which has the function which 
memorizes the sense of the field angle of two or more places, and the combination of 
a dilation ratio beforehand, and can be chosen at any time. An infrared sensor opposes 
the infrared exposure section and an infrared light sensing portion, is installed, and is 
considered as detection of an invasion body with detection of an invasion body 
interrupting infrared radiation through between the exposure section and light sensing 
portions. 

[0004] An infrared sensor is formed in 1 in a monitor object domain, or several places, 
and the sense and dilation ratio of a field angle of a camera with a preset feature are 
doubled with the location of said infrared sensor. Detection of an invasion body of one 
of the infrared sensors carries out actuation which records on videotape the image 
which this was interlocked with, and the sense and dilation ratio of a field angle were 
chosen, and was caught with said camera with a preset feature with image 
transcription equipment. 

[0005] Moreover, in invention given in JP,2000-209571,A, the infrared sensor 
detected the invasion body to the above-mentioned conventional-type image 
supervisory equipment with the configuration which added the image processing 
system, the image containing an invasion body was processed with the image 
processing system, and the field angle and dilation ratio of a camera with a preset 
feature are determined according to change of brightness. 

[0006] Furthermore, by invention of a publication, it changed from a camera, image 
transcription equipment, the monitor, and the image processing system to 
JP.1 1-45379,A, the image of a camera was processed with the image processing 
system, the motion in a monitor object domain was detected, and this motion part is 
recorded on videotape as an invasion body, or is reported to the hitcher on. 
[0007] Moreover, the image of the monitor object domain where an invasion body does 
not exist in JP.1 1-355764,A by invention of a publication is held as a criteria image, 
the brightness of the present image of a monitor object domain and a criteria image is 



measured, and the part which produces a brightness difference is detected as an 
invasion body. Furthermore, the field angle and dilation ratio of a camera are 
determined that the location of an invasion body will come to a core. 
[0008] 

[Problem(s) to be Solved by the Invention] However, in invention given in 
above-mentioned conventional-type image supervisory equipment and 
above-mentioned JP,2000-209571 A detection of an invasion body is possible only in 
the location in which the infrared sensor in a monitor object domain is installed, and it 
has the first technical problem that an invasion body is undetectable in locations 
other than this. 

[0009] Moreover, even when the wave of the water surface, reflection, the branches 
and leaves of trees, etc. use invention of a publication for JP, 11 -45379, A and 
JP,11-355764,A in the scene which has a motion in a background, and an invasion 
body does not exist, the second technical problem that these motions in a monitor 
object domain are accidentally detected with an invasion body occurs. 
[0010] By the way, if a vessel navigates, a track will generate on the ocean behind this 
vessel. A track is conspicuous in a vessel being high-speed, and it appears, and. 
moreover, reaches by several times the magnitude of a vessel. When invention of a 
publication is applied to JP,11-45379.A and JP.1 1-355764.A in the above situations, 
the track of this vessel is regarded as an invasion body, and the third technical 
problem that only a track is recorded also on an image transcription image occurs. 
[0011] The purpose of this invention is to offer the image supervisory equipment 
which can detect an invasion body with a sufficient precision, without 
incorrect-detecting a motion for backgrounds, such as a wave of the water surface, 
reflection, and branches and leaves of trees. 

[0012] Other purposes of this invention measure an invasion body's existence 
coordinate correctly, and are to offer the image processing system which can turn the 
field angle of a camera to this coordinate. 
[0013] 

[Means for Solving the Problem] As the first aspect of this invention for solving the 
first technical problem, the image of a monitor object domain is processed and it 
considers as an invasion body candidate with a local brightness difference with a 
criteria image, several frames are covered and said invasion body candidate is pursued, 
after checking having moved beyond a predetermined distance, it judges as an 
invasion body, and it reports to a hitcher on or records on videotape to image 
transcription equipment. 

[0014] If the monitor object domain whole region is stored in the field angle of a 
television camera by the above configuration, it will become detectable [ an invasion 
body ] throughout a monitor object domain. First of all. after some invasion bodies 
move, you may report in many cases, and it becomes possible by taking the first 



aspect to catch the invasion body which moves, without reacting to branches and 
leaves, the reciprocating motion of a flag, and fluctuation of the water surface. 
[0015] As what is added to the same configuration as the first aspect as the second 
aspect of this invention for solving the second technical problem, as said criteria 
image, it has two or more criteria images, and according to [ for detection ] is provided 
with the image supervisory equipment characterized by detecting an invasion body 
based on the local brightness difference of each criteria image and a monitor object 
domain image. 

[0016] Since it is the criteria image with which the first criteria image in two or more 
criteria images is a criteria image updated sufFiciently promptly using the monitor 
object domain image of several frame past from one frame, and fluctuation of a wave 
or trees was also incorporated It is hard to produce the brightness difference based 
on fluctuation of a wave or trees, and while it is rare to incorrect-detect fluctuation of 
these waves or trees with an invasion body, if an invasion body crosses a monitor 
object domain at a certain amount of rate, a brightness difference arises between 
criteria images and said invasion body can be detected to it. 

[0017] however, the wave, the trees, and ** which swing when an invasion body 
invades at an extraordinary low speed — an invasion body will also be incorporated by 
the first criteria image like, and there is a problem that a low-speed invasion body 
cannot be caught. In order to solve this problem, the second criteria image is used, by 
load predetermined [ several frames ] in the past, averaging of the second criteria 
image is carried out. and it is obtained. If averaging of several frames is carried out. 
while the fluctuation of a wave or trees will be equalized and time brightness 
fluctuation will be offset, the stationary rock and the stationary building become the 
good criteria image of contrast carried out distinctly. 

[0018] Moreover, if averaging of from several past of the image of a monitor object 
domain to the present frame is carried out by predetermined load as a monitor image, 
while the time variation of the brightness by fluctuation of a wave or trees will be 
offset, the invasion body which is moving at a low speed or is standing it still becomes 
the good monitor image of contrast carried out distinctly. If the local brightness 
difference of the second criteria image and the monitor image by averaging is 
searched for, an invasion body can be detected without catching fluctuation of a wave 
or trees, 

[0019] However, by the monitor image by averaging, the body which moves at high 
speed tends to fade, and it is hard to detect it. Then, it is desirable to detect the 
invasion body more than a certain rate, and to detect the invasion body below the rate 
which is the second criteria image by the first criteria image. 

[0020] It is characterized by establishing a reflected light detection means and a 
silhouette body detection means as what is added to the same configuration as the 
second aspect as the third aspect of this invention for solving the second technical 



problem. 

[0021] The body detection processing based on the first criteria image and the 
second criteria image is locally cancelled temporarily to an invader body candidate's 
field noting that an invader body candidate is reflection of the sun etc., i.e.. the 
reflected light, when a reflected light detection means has the brightness of the field 
detected as an invasion body candidate higher than predetermined brightness. That is, 
the mask of body detection processing is temporarily carried out to an invader body 
candidate's field. 

[0022] Thus, if an invasion body exists in the field to which the reflected light exists, 
unless an invasion body is a powerful emitter, a body part will surely be in the 
silhouette condition smeared away black. Then, if a silhouette body detection means 
detects the invasion body which changed into the silhouette condition, even if an 
invasion body is in the field cancelled temporarily about the body detection processing 
based on the first criteria image and the second criteria image, it will be possible to 
detect this and. moreover, the reflected light will not be incorrect-detected with an 
invasion body. 

[0023] Thus, if it is made the third aspect, when the solar powerful light source 
reflects on the water surface, the reflected light can move according to fluctuation of 
a wave, and the problem that a local difference arises and incorrect detection arises 
between the first criteria image and a monitor image can be solved. 
[0024] It is made which configuration of the third aspect from the first as the fourth 
aspect of this invention for solving the third technical problem. In case an invasion 
body candidate is pursued, the rate or the migration direction of an invasion body 
candidate is measured, and it is characterized by reporting the part containing the 
profile by the side of an invasion body candidate's migration direction to a hitcher on 
as an invasion body candidate's location, recording on videotape, or doubling the field 
angle and dilation ratio of another camera. By the above trace processing, even if the 
track remains after the invasion body, the invasion body itself can be caught exactly. 
[0025] In addition, the dynamic image obtained from a camera consists of a sequence 
of a static image, and every sheet of the still picture which is this sequence image will 
be called a frame in this specification. The dynamic image of the television camera of 
a standard NTSC specification is constituted by about 30 frames per second. 
[0026] 

[Embodiment of the Invention] The gestalt of operation of this invention is explained 
with reference to a drawing. Although invasion ship supervisory equipment on the 
ocean is explained as an example below, this invention is not restricted to this. 
[0027] Drawing 13 is an example of the operation gestalt of the image supervisory 
equipment of this invention. In drawing 1 3 , the camera 1301 and the camera 1302 are 
installed in the stanchion 1303 fixed to the quaywall or the seaside building 1304. A 
camera 1 301 can change the sense with the field angle adjusting device 1 306, or can 



change a dilation ratio. The camera 1 302 has set up the field angle so that the whole 
monitor object domain may be covered. 

[0028] A hitcher on can view the image of a camera 1301 through a monitor 1305, and 
it can be recorded on videotape to image transcription equipment 1 308. Although not 
illustrated by the field angle adjusting device 1306, image transcription equipment 
1308, and the monitor 1305. the interface of MAMMASHIN exists, and through this 
man machine interface, a hitcher on can control the field angle of a camera 1301 
manually, and can view said monitor object domain through a monitor 1305. The image 
of a camera 1 301 can be recorded on videotape to image transcription equipment 
1308 if needed. 

[0029] If the image processing system of this invention is made into automatic mode, 
an image processing system 1305 will process the image of a camera 1302, if the 
invasion ship 1 31 2 exists in a monitor object domain, this will be detected and the field 
angle and dilation ratio of a camera 1301 will be automatically controlled through the 
field angle adjusting device 1 306 according to the detection location of the invasion 
ship 1312. 

[0030] An image processing system 1305 is reported to a hitcher on through 
information equipment 1307 while it controls image transcription equipment 1308 and 
records the image of a camera 1301 on videotape. A hitcher on is told with the 
information means 1 307. Approaches, such as voice and flashing of light, can be taken 
as an approach of telling. 

[0031] Moreover, a monitor 1 310 is formed, you may enable it to check the image of a 
camera 1302. image transcription equipment 1308 is formed, and you may enable it to 
record the image of a camera 1302 on videotape. Moreover, it always records on 
videotape using what has the function in which an overwrite image transcription is 
possible to image transcription equipment 1 308, and if image transcription actuation is 
suspended with the output of an image processing system 1 305, before the invasion 
ship 1 31 2 invades, it can leave the image of an immediately after [ invasion ] from from. 
[0032] In addition, it is not necessary to necessarily install a camera 1301 and a 
camera 1 302 in the same stanchion. 

[0033] If the monitor object domain whole region is stored in the field angle of a 
television camera by taking the above configuration, there is effectiveness it is 
detectable [ an invasion body ] ineffective throughout a monitor object domain. First 
of all. after some invasion bodies move, you may report in many cases, and there is 
effectiveness it is ineffective to it being possible to catch the invasion body which 
moves by taking above voice, without reacting to branches and leaves, the 
reciprocating motion of a flag, and fluctuation of the water surface. 
[0034] Next, the second example of the image supervisory equipment of this invention 
is explained. The second example of the image supervisory equipment of this invention 
is made the same configuration as the first example. The configuration of an image 



processing system 1305 As shown in drawing 1 , the image input means 101 and the 
time series image maintenance means 102, The averaging image creation means 103 
and the migration body detection means 104 of a high speed and a usual rate, It 
consists of the silhouette body detection means 105, a low speed and the halt body 
detection means 106, the detection body selection means 107, the environmental 
analysis means 108, the body trace means 109. the invasion body judging means 110. 
and the display means 111. 

[0035] The image input means 101 captures and carries out analog-to-digital 
conversion of the image of a camera 1302. The time series image maintenance means 
102 holds two or more images of time series. The averaging image creation means 103 
carries out averaging of the image of the time series image maintenance means 102 by 
predetermined load, and creates an addition image. The migration body detection 
means 104 of a high speed and a usual rate creates and holds the criteria image 
containing fluctuation from the time series image of the time series image 
maintenance means 102. 

[0036] The criteria image containing fluctuation is a criteria image which incorporates 
and updates fluctuation of backgrounds, such as a wave and a grove, and is a criteria 
image which eliminated the change accompanied by bigger brightness fluctuation than 
fluctuation of a background. The field beyond a value predetermined In the brightness 
difference of the high-speed and newest **** to which a time series image 
maintenance means usually holds the migration body detection means 104 of a rate, 
and said background image containing fluctuation is outputted as an invasion body 
candidate. The binary picture data which carried out binarization of an invasion body 
candidate field and the other field are sufficient as an output form, and the coordinate 
of the circumscription rectangle of this invasion body candidate field is sufficient as it. 
[0037] It classifies into a high speed and the part which is not usually so intense as 
the intense part of fluctuation by distribution of the brightness difference of the 
averaging image of the averaging image creation means 103, and the newest **** of 
the time series image maintenance means 102 as for the migration body detection 
means 104 of a rate. Although the invasion body candidate is detected having used 
the predetermined value as the threshold for the brightness difference of the newest 
*♦** and the background image containing fluctuation, the possibility of incorrect 
detection of the invasion body by fluctuation of a wave or a grove is also reducible by 
making said threshold adjustable in the intense part of fluctuation, and the part which 
is not intense, for example, making a threshold high in the intense part of fluctuation. 
However, this is not indispensable. 

[0038] By the way. an invasion body will be silhouette-ized if an invasion body exists 
between a camera and the solar light source. At this time, the field of high brightness 
of reflection according [ the image of a camera ] to the light source exists, and 
silhouetteHzation of this invasion body is seen as a low brightness field in the field of 



high brightness. 

[0039] The silhouette body detection means 105 has the function to detect this 
silhouette-ized invasion body. The silhouette body detection means 105 reflects the 
field more than a brightness threshold predetermined in the inside of the averaging 
image of the averaging image creation means 1 03, considers that it is a field, and is 
detected as an invasion body candidate who silhouette-ized the field below the 
brightness threshold for silhouette detection in said reflection field of the newest 

of the time series image maintenance means 1 02. 
[0040] A low-speed body and the halt body detection means 106 detect the large field 
of a spatial brightness change of the averaging image of the averaging image creation 
means 103 as a candidate of a low-speed body or a halt body. 

[0041] Since the migration body detection means 104 of three body candidate 
detection means, i.e., a high speed, explained above and a usual rate, the silhouette 
body detection means 105, and a low-speed body and the halt body detection means 
106 change invasion body detectability ability by the height of the passing speed of an 
invasion body, the existence of reflection of a monitor object domain, etc., if these are 
used together and combined, they will become effective supervisory equipment. 
[0042] The detection body selection means 107 unifies a high speed and the detection 
result usually according to the migration body detection means 104 of a rate, the 
silhouette body detection means 105, and a low-speed body and the halt body 
detection means 1 06, respectively. 

[0043] The image supervisory equipment of this invention can set up the function of 
the detection body selection means 107 according to operational environment. For 
example, in the employment which stations the hitcher on who concentrates on 
monitor business, the detection body selection rneans 107 is manually operated by 
decision of a hitcher on, and a high speed and the detection result usually according to 
the migration body detection means 104 of a rate, the silhouette body detection 
means 105, and a low-speed body and the halt body detection means 106 can be 
made into an invalid, or can be confirmed, respectively. At this time, the OR of the 
result of each technique will be carried out an effective detection body. 
[0044] Furthermore, the environmental analysis means 108 may be established, the 
environment of a monitor object domain may be judged, and the change of the 
effective invalid of each detection result in the detection body selection means 1 07 
may be automated. 

[0045] The display means 1 1 1 can display the situation of the environmental analysis 
means 108 of operation, and can display the analysis result of a monitor object domain, 
and the selection result of the detection body selection means 107. When a hitcher on 
operates the detection body selection means 107 manually, it can also refer to the 
environmental analysis result which the display means 1 1 1 displays. 
[0046] The body trace means 109 continues and pursues the detection body which 



became effective to a multiple frame with the detection body selection means 1 07. It 
judges whether the invasion body judging means 110 is a noise according whether a 
trace body is an invasion body based on the trace result of the body trace means 109 
to fluctuation etc., and the result is considered as the output of an image processing 
system 1305. 

[0047] By taking the above configuration, the invasion body which changed it into the 
silhouette condition to malfunction in branches and leaves, the reciprocating motion 
of a flag, and fluctuation of the water surface by few invasion bodies and backlight of 
the motion by fluctuation of these backgrounds in addition to the ability to stop 
sharply can also be caught with sufficient sensibility. Furthermore, by displaying the 
analysis result of the environmental analysis means 1 08, it is easy to grasp a situation 
of operation for a hitcher on, and there is effectiveness it is ineffective to the system 
which is easy to treat. 

[0048] The supervisory equipment of this invention is possible also for realizing by 
computer equipped with the image acquisition interface and the signal output 
interface, and becomes the flow of processing shown in drawing 2 . 
[0049] In drawing 2 , the memory area for each parameter and image storing is 
initialized (step 1). In addition to the ability to prevent incorrect actuation by this, it 
puts into invasion body detection actuation promptly after monitor cycle initiation. 
When the existence of interruption of a termination instruction is checked and a 
termination interrupt is after monitor cycle initiation, processing is ended, and when 
there is no termination interrupt, it shifts to step 3 (step 2). 

[0050] The image of a monitor object domain is acquired through an image acquisition 
interface (step 3). It updates by the image acquired at step 3, holding the time series 
image of required number of sheets (step 4). The averaging image of the time series 
image to current is updated (step 5). 

[0051] A high speed vessel effective flag, a silhouette effective flag, and a low-speed 
ship effective flag are formed, and effective or an invalid is beforehand set up by initial 
setting of step 1 . If the high speed vessel effective flag is effective, migration body 
detection processing of a high speed vessel and a usual rate will be performed (step 6). 
If the silhouette effective flag is effective, silhouette body detection processing will be 
performed (step 7). If the low-speed ship effective flag is effective, a low speed and 
halt body detection processing will be performed (step 8). Processing of step 6 
thru/or step 8 may be performed in any order, without restricting in order of drawing 
2 . 

[0052] The bad weather of a wave and a white horse stand from magnitude and the 
number of the invasion body candidate by the brightness, step 6. or step 8 of an 
average addition image, condition and the existence of reflection are judged, the 
validity of the effective flag of step 6 thru/or step 8 and an "invalid" are set up. or the 
height of the threshold of invasion body candidate detection of step 6 thru/or step 8 



is controlled by environmental analysis processing (step 9). These flags and a 
threshold become effective, when carrying out image acquisition again, the following 
monitor cycle 3. i.e., step, and performing step 6 thru/or 8. 

[0053] as an example of the environmental analysis of step 9 — some averaging 
images — when the average luminance of a field is larger than a predetermined value, 
the method of detecting step 6 which is [ incorrect-] easy to detect by reflection is 
halted, or a camera 1302 judges with the backlight condition suitable for the light 
source, raises a detection threshold, and dulls sensibility. 

[0054] In the state of such a backlight, since an invasion body changes in the shape of 
a silhouette, it raises the sensibility of the method of detecting step 7. Moreover, 
when the ^^^^ office detected by the method of detecting step 6 has, many the things, 
i.e., the noise, which do not result by the judgment of an invasion body, while judge it 
as the condition that a wave is ruined and many white horses stand, weaken the 
sensibility of step 6 and reducing the possibility of incorrect detection, in order to 
detect the body which hides in waves and invades at a low speed, the sensibility of the 
processing which detects the low-speed ship of step 8 maintains. 
[0055] In body trace processing (step 10), location and description of the invasion 
body candidate who detected in the pre-monitor cycle are held beforehand, location 
and description of the invasion body candidate who detected in the present monitor 
cycle are collated, and this invasion body candidate's migration situation is measured. 
Collating of the invasion body candidate between such monitor cycles is performed by 
calculating the distance in which this invasion body candidate is located between 
monitor cycles, and considering that the invasion body candidate by the side of 
recently is migration of the same invasion body candidate, when one or more invasion 
body candidates for example, in each monitor cycle are detected. 
[0056] Moreover, when an invasion body candidate's magnitude differs greatly 
between monitor cycles, and when distance is large, it can also remove from the 
candidate of collating. Furthermore, the similarity of this invasion body candidate's 
luminance distribution can also be measured and collated by pattern-matching 
processing. Moreover, change of the rate to a front frame can also be collated so that 
it may become min. 

[0057] In display processing (step 1 1 ), when display the result of the environmental 
analysis of step 9. the situation of step 6 thru/or step 8 of operation is displayed or an 
invasion body exists in a monitor object domain if needed, it can surround and express 
as a frame. In invasion body judging processing (step 12). it judges with an invasion 
body from said invasion body candidate's trace situation, and through a signal output 
interface, make a camera 1301 follow with the field angle adjusting device 1306, the 
information means 1307 reports to a hitcher on, or the image of an invasion body is 
recorded with image transcription equipment 1 308. 

[0058] Next, it results in image acquisition of step 3 through the check of a 



termination interrupt at step 2. and a monitor cycle is repeated. 

[0059] It is effective in an invasion body being always detectable using the calculation 
speed of the newest personal computer by the flow of processing in case the above 
carries out an image processing system 1305 by computer. 

[0060] Next, "the migration body detection means 104 of a high speed and a usual 
rate" is called the detection means 104 for short, and the detail of the first example of 
the detection means 104 is explained based on drawing 3 . 

[0061] In drawing 3 . the detection means 104 consists of the amount measurement 
means 301 of fluctuation, the criteria image creation means 302 containing fluctuation, 
the detection invalid field setting means 303, the body detection means 304. and the 
detection object presence effect invalid Judging means 305. The image of the monitor 
object domain where an invasion body does not exist is held as a criteria image, 
brightness change of the image of said monitor object domain produced with an 
objective invasion is caught, and a basic principle detects an invasion body. 
[0062] However, for preventing incorrect detection under the background for which a 
wave, trees, etc. swing, it is necessary to incorporate fluctuation in a criteria image. 
Moreover, since the amount of fluctuation which should be incorporated changes 
every moment, it needs to measure this change and needs to acljust the amount of 
incorporation of fluctuation automatically. 

[0063] The detection means 104 is carrying out the configuration which realizes this, 
and the amount measurement means 301 of fluctuation measures the amount of 
brightness fluctuation of the swinging field in several frames to the newest frame of 
the time series image maintenance means 102. 

[0064] As an example of measurement of the amount of fluctuation, as shown in 
drawing 4 , the amount observation window 401 of fluctuation thru/or 404 are 
prepared. Drawing 4 is the image on the ocean caught with the camera 1 302, drawing 4 
(a) is the image of the monitor object domain of the newest frame, and drawing 4 (b) is 
the image of the monitor object domain of several frame past. 

[0065] For example, in order to measure the amount of fluctuation of the brightness 
by the swinging wave, the amount observation window 401 of fluctuation thru/or 404 
are prepared in four places, the brightness in the fluctuation observation window 401 
— a fluctuation of a wave sake — changing — **** — drawing 4 (a) — the newest 
frame and drawing 4 (b) — several frames past images — brightness — if difference is 
taken and binarization is carried out with a predetermined threshold, it will become the 
image of drawing 5 (a). 

[0066] Since the brightness change for every frame will become large if it will be in the 
large condition [ wave ] of fluctuation, if binarization is carried out with a 
predetermined threshold, the area of difference will become like drawing 5 (b) greatly 
from drawing 5 (a). Since the brightness change for every frame will decrease if it will 
be in a condition [ wave ] with little fluctuation, if binarization is carried out with this 



predetermined threshold, the area of difference will become like drawing 5 (c) few 
from drawing 5 (a). 

[0067] The area of a binary ghost object becomes small like drawing 5 (c). so that the 
area of a binary ghost object is so large that fluctuation of a wave becomes large when 
a threshold is fixed so that the above explanation may show like drawing 5 (b) and 
fluctuation of a wave is small. 

[0068] A binarization threshold is enlarged when larger than both fixed numeric values 
whose area of a binary ghost object is two about the area of a binary ghost object as 
compared with two fixed numeric values. By making a binarization threshold small, 
when the area of a binary ghost object is smaller than both fixed numeric values which 
are two, the area of a binary body can be maintained at the fixed range, and the 
magnitude of a threshold can be fluctuated according to the magnitude [ wave ] of 
fluctuation. 

[0069] That is, if fluctuation of a wave becomes large, a threshold will become large 
and the part from which result inter-frame brightness changes a lot will also become 
is also hard to be detected as a binary body. If fluctuation of a wave becomes small, a 
threshold will become small and will become that it is easy to be detected as a binary 
ghost object also in a part with little inter-frame brightness change as a result. 
[0070] Here, the output of the amount measurement means 301 of fluctuation 
presupposes that it is a binarization threshold for carrying out area of the amount 
observation window 401 of fluctuation thru/or the binary ghost object in 404 near 
[ predetermined ] the value. When a respectively different threshold is obtained from 
the amount observation window 401 of fluctuation thru/or 404. the average of four 
thresholds can also be made into a final threshold, and a median can also be taken. 
This is henceforth called a fluctuation threshold. 

[0071] The criteria image creation means 302 containing fluctuation creates the 
criteria image containing fluctuation using the time series image of the time series 
image maintenance means 102. Speciflcally, let the newest of camera 1302 

acquisition be said criteria image containing fluctuation in initialization (step 1). For 
every continuing monitor cycle, the brightness subtraction image of the newest 
of the time series image maintenance means 102 and said criteria image containing 
fluctuation is created, and binarization is carried out with a fluctuation threshold. The 
binary body detected at this time is a field which produces bigger brightness 
fluctuation than fluctuation of the wave in the amount observation window 401 of 
fluctuation thru/or 404. 

[0072] On the other hand, except this field, it is the amount observation window 401 
of fluctuation thru/or a field with less brightness fluctuation than fluctuation of the 
wave in 404. and it restricts to this field and the criteria image containing fluctuation is 
updated by the luminance distribution of the newest 

[0073] By the above processing, the criteria image containing fluctuation turns into a 



criteria image of entering [ which incorporated the fluctuation below fluctuation of the 
wave in the amount observation window 401 of fluctuation thru/or 404 ] fluctuation. 
[0074] The body detection means 304 can detect the part which produces bigger 
brightness fluctuation than fluctuation of the wave in the amount observation window 
401 of fluctuation thru/or 404 as a binary ghost object by creating the brightness 
subtraction image of the newest image of the time series image maintenance means 
102, and the criteria image of the criteria image creation means 302 containing 
fluctuation, and carrying out binarization with a predetermined threshold. 
[0075] The detection object presence effect invalid judging means 305 sets up the 
circumscription rectangle of a binary ghost object, measures magnitude, and outputs 
the binary ghost object of the predetermined range as an invasion body candidate. By 
taking the above configuration, it corresponds to change of the amount of fluctuation 
of a background promptly, and regulating automatically is possible and it is effective in 
the ability of incorrect detection to realize little highly sensitive image supervisory 
equipment. 

[0076] They are a high speed and the configuration of having usually added the 
detection invalid field setting means 303 to the 1 st example as the second example of 
the migration body detection means 104 of a rate. The detection invalid field setting 
means 303 judges the existence of reflection by the roughness of the local wave in a 
monitor object domain from the noise generating situation of the newest image of the 
time series image maintenance means 102. the averaging image of the averaging 
creation means 1 03. and the pre-monitor cycle of a detection object presence effect 
invalid judging means, in the rude part of a wave, makes high the binarization threshold 
of the body detection means 304, and can prevent generating of incorrect detection. 
[0077] Moreover, in a part with reflection, generating of incorrect detection is 
prevented by setting up so that it may not detect completely. Detection of the 
invasion body to said reflection field is suppliable with the silhouette body detection 
means 105. 

[0078] The example of the detection invalid field setting means 303 of operation is 
shown in drawing 6 . Drawing 6 (a) is the screen of a monitor object domain, 601 is a 
quaywall part without fluctuation, and the other part is a part into which a wave swings. 
If processing is added for the image of a monitor object domain with the averaging 
image creation means 103 and an averaging image is created, the part of a field 601 
carries out the same luminance distribution as the correspondence part of a monitor 
object domain, and the part into which it swings other than field 601 is the average 
luminance of an applicable part, and if there is no reflection, it will become almost 
uniform brightness, 

[0079] every monitor cycle — the brightness of an averaging image and the image of a 
monitor object domain — difference — if binarization is carried out with a 
predetermined threshold after continuing and accumulating cloth in two or more 



cycles, as shown in drawing 6 (b). the field 602 corresponding to 601 will be black, and 
the other field will become white. Since a white field is the intense part of the 
brightness fluctuation by fluctuation, it sets up the detection threshold of the body 
detection means 304 highly, and can prevent incorrect detection. 
[0080] On the other hand, since a black field is the small part of brightness fluctuation, 
even if it sets up the detection threshold of the body detection means 304 low and 
raises detection sensitivity, possibility of an incorrect alert can be made low. 
Furthermore, it is a white field and the part with the brightness value of an averaging 
image higher than a predetermined value can also suspend processing of the body 
detection means 304 as a part which has generated reflection. 

[0081] There is effectiveness which controls Incorrect detection without dropping 
detection sensitivity on taking the above configuration, since it succeeds in the 
optimal adjustment for each field even if the intense parts of fluctuation or reflection 
are in 1 screen. 

[0082] Next, the detail of the first example of the silhouette body detection means 
105 is explained based on drawing 7 . 

[0083] In drawing 7 , the silhouette body detection means 1 05 consists of a silhouette 
field detection means 701 and a body detection means 702. With the silhouette field 
detection means 701, the field more than brightness predetermined by the averaging 
image by the averaging image creation means 103 is chosen. 

[0084] Furthermore, carry out binarization of the newest image of the time series 
image maintenance means 102 in the field more than predetermined brightness, using 
another predetermined brightness as a threshold, and let the field where brightness is 
low be a silhouette body candidate. It is outputted from the silhouette body detection 
means 105, using the body detection means 702 as the invasion body candidate who 
silhouetteHzed the silhouette body candidate by the silhouette field detection means 
701. It is effective In the ability to catch the silhouette-ized invasion body without 
relation to the passing speed by taking the above configuration. 

[0085] Depending on a monitor field, a building may exist in a monitor object domain, 
and it will become the invasion body candidate who also sllhouette-ized these and 
silhouette-lzed them in the first example of the silhouette body detection means 105 
in the state of the backlight. Then, the second example of the silhouette body 
detection means 105 is the configuration of having added the criteria image creation 
means 703 and the detection invalid field setting means 704 to the configuration of 
the first example. 

[0086] If the image in which an invasion body does not exist is inputted from a camera 
102 in advance of monitor actuation — the first example and ** — since what the 
building in this monitor field silhouetteHzed like is detected, it holds for the criteria 
image creation means 703 by making this into a criteria image. The detection invalid 
field setting means 704 outputs the field of a building as an invalid field by the criteria 



image which the criteria image setting means 703 holds. 

[0087] The body detection means 702 is outputted as a body which silhouette-ized 
the thing excluding the invalid field of the detection invalid field setting means 704 
from the silhouette ghost object by the silhouette field detection means 701 at the 
time of monitor operation. 

[0088] Even when a building etc. is in a monitor field and these silhouette-ize by 
taking the above configuration, it is effective in the ability to catch an invasion body 
without incorrect detection. 

[0089] However, if the solar light source moves with time amount, the shadow of a 
building will also move. Then, the third example of the silhouette body detection 
means 1 05 is the configuration of having added the updating stage generating means 
705 to the configuration of the second example. 

[0090] The updating stage generating means 705 is conveyed to the criteria image 
creation means 703 as an updating signal, only when a signal is made with the time 
interval decided beforehand and the invasion body does not exist. If an updating signal 
comes, as for the criteria image creation means 703. let this be a detection invalid 
field for the output of the silhouette field detection means 701 in this time henceforth 
as a new criteria image next time till updating. 

[0091] It is effective in the ability to catch an invasion body, without carrying out 
incorrect detection, even if how to be able to do a silhouette with migration of the light 
source by taking the above configuration changes. 

[0092] Next, "a low speed and the halt body detection means 106" are written as the 
body detection means 1 06, and the detail of the first example of the body detection 
means 106 is explained based on drawing 8 . 

[0093] If the monitor image currently continuously changed like waves is processed 
with the averaging image creation means 103. the fluctuation part of brightness will be 
equalized in time and will become the scarce image of a motion from which light and 
darkness change gently also spatially. If the invasion body is standing it still in a field, 
in an operation of averaging processing, the luminance distribution of an invasion body 
will become the image with a sufficient signal noise ratio carried out distinctly. 
Moreover, when an invasion body moves at a low speed, although the image of an 
invasion body carries out dotage, the luminance distribution carried out more clearly 
than the wave always changed appears. 

[0094] The body detection means 106 is a means to detect the invasion body which 
used this property, and has moved or stopped at a low speed, and consists of a space 
differential processing means 801 and a body detection means 802. the difference of 
the pixels which the space differential processing means 801 is the processing which 
detects the field which changes brightness rapidly spatially, and adjoin — it processes, 
difference — a well-known differential operator may be made to act on a change of 
processing After emphasizing the field which changes brightness a lot spatially by the 



above technique, binarization is carried out with a predetermined threshold and a body 
is detected. 

[0095] The body detection means 802 is outputted from a low speed and the halt body 
detection means 106 by making into a low speed or a stopped invasion body candidate 
the body which the space differential processing means 801 detected. It is effective in 
few invasion bodies of a motion being detectable from fluctuation of a background by 
taking the above configuration. 

[0096] Depending on a monitor field, a building may exist in a monitor object domain, 
by the averaging image, luminance distribution will clarify and these will also be 
detected as a body candidate. Then, the second example of a low speed and the halt 
body detection means 106 is the configuration of having added the criteria image 
creation means 803 and the detection invalid field setting means 804 to the 
configuration of the first example. 

[0097] if the image in which an invasion body does not exist is inputted from a camera 
102 in advance of monitor actuation — the 1st example and ** — since what the 
building in this monitor field is large, and changes like is detected, it holds for the 
criteria image creation means 803 by making this into a criteria image. The detection 
invalid field setting means 804 outputs the field of a building as an invalid field by the 
criteria image which the criteria image creation means 803 holds. 
[0098] The body detection means 802 outputs the thing excluding the invalid field of 
the detection invalid field setting means 804 from the detection body by the space 
differential processing means 801 as a body under a low speed and halt at the time of 
monitor operation. It is effective in an invasion body being detectable, without 
incorrect-detecting these, even if there are a building, a rock, etc. which were 
controlled in the detection field by taking the above configuration. 
[0099] A wave is filled and the brightness pattern of a building changes with length. 
Then, the third example of the body detection means 106 is the configuration of 
having added the updating stage generating means 805 to the configuration of the 
second example. The updating stage generating means 805 is conveyed to the criteria 
image creation means 803 as an updating signal, only when a signal is made with the 
time interval decided beforehand and the invasion body does not exist. If an updating 
signal comes, as for the criteria image creation means 803, let this be a detection 
invalid field for the output of the space differential processing means 801 in this time 
henceforth as a new criteria image next time till updating. It is effective in the ability 
to catch an invasion body, without incorrect-detecting these by taking the above 
configuration, even if a building, a rock. etc. change with time of day. 
[0100] Next, drawing 9 explains actuation of the environmental analysis means 108. 
Counting of a high speed and the occurrences per unit time amount of the body which 
was not chosen with a detection body though the migration body detection means 1 04 
of a rate usually detected is carried out (step 1). counting of step 1 — the number 



beforehand decided to be a result is compared, when there are more occurrences, it 
progresses to step 2, it is few, or when the same, it progresses to step 3. 
[0101] Since there are many noises with the migration body detection means 104 of a 
rate as for a high speed, and the case where fluctuation of a wave etc. is large and the 
strong case of reflection by the backlight, such information is usually displayed with 
the display means 111 (step 2). When the detection body selection means 107 is in 
automatic switchover mode, area of the high-speed and nullification field which 
usually makes an invalid extensively the output of the migration body detection means 
1 04 of a rate, and displays that on the display means 1 1 1 . or the detection invalid field 
setting means 303 sets up is extended (step 2). 

[0102] Moreover, when the brightness of the averaging image of the averaging image 
103 is high, it judges that reflection has occurred in the state of a backlight, and that 
is displayed on the display means 1 1 1 (step 2). Though the silhouette body detection 
means 105 detects, counting of the occurrences per unit time amount of a detection 
body and the body which was not chosen is carried out (step 3). counting of step 3 — 
the number beforehand decided to be a result is compared, when there are more 
occurrences, it progresses to step 4, it is few, or when the same, it progresses to step 
5. 

[0103] The thing with many noises is because the criteria image of the criteria image 
creation means 703 for silhouettes is unsuitable in connection with migration of the 
light source with the silhouette body detection means 105, and while updating said 
criteria image, such information is displayed with the display means 1 1 1 (step 4). 
Though a low speed and the halt body detection means 1 06 detect, counting of the 
occurrences per unit time amount of a detection body and the body which was not 
chosen is carried out (step 5). counting of step 5 — the number beforehand decided 
to be a result is compared, when there are more occurrences, it progresses to step 6, 
it is few, or when the same, it ends. 

[0104] The shadow of a building etc. changes with migration of the light source with a 
low speed and the halt body detection means 106, the thing with many noises is 
because the criteria image of the criteria image creation means 803 is unsuitable, and 
it displays such information with the display means 1 1 1 while it updates a criteria 
image (step 6). 

[0105] Since an operation situation is displayed while regulating automatically is 
carried out to the processing which suited the present environment for a monitor by 
taking the above configuration, it is easy to treat for a hitcher on, and effective in also 
finding faults, such as failure, at an early stage moreover, and being easy to respond. 
[0106] Next, the detail of the body trace means 109 is explained. Based on drawing 1 0 . 
the difference between the body pursuing method of the body trace means 1 09 and 
the conventional body pursuing method is explained. 

[0107] Drawing 1 0 (a) is drawing showing the conventional body pursuing method, and 



shows in piles the body 1001 detected with the present frame, and the body 1002 
detected with the front frame on the same screen. It wrote A [ the core of a body 
1001 or the core of the circumscription rectangle of a body 1001 ], and it writes B 
[ the core of a body 1 002 or the core of the circumscription rectangle of a body 1 002 ]. 
The vector AB which connects Core A and Core B with the conventional body 
pursuing method was considered as migration of a body inter-frame [ said ]. 
[0108] Drawing 10 (b) is drawing showing the body pursuing method of the body 
detection means 109, and shows in piles the body 1001 detected with the present 
frame, and the body 1 002 detected with the front frame on the same screen. 
[0109] It wrote A [ the core of a body 1001 or the core of the circumscription 
rectangle of a body 1001 ], and it writes B [the core of a body 1002 or the core of the 
circumscription rectangle of a body 1002 ]. Moreover, a vector 1003 is a vector 
showing migration of this body to a front frame. 0 shows the crossover point of the 
segment developed in parallel with a vector 1003 from the core of a body 1001. or the 
core A of a circumscription rectangle, and the profile of a body 1 001 or the profile of a 
circumscription rectangle. D shows the crossover point of the segment developed in 
parallel with a vector 1003 from the core of a body 1002, or the core B of a 
circumscription rectangle, and the profile of a body 1002 or the profile of a 
circumscription rectangle. At this time, the vector DC which connects D and C is 
considered as migration of said inter-frame body. 

[01 10] Although the inter-frame bodies 1001 and 1002 do not change a form like the 
rigid body in the example of drawing 10 When pursuing the vessel which raises the 
flight body which moves while taking out smoke, such as a rocket and a missile, and 
wave splash, and navigates Since it detected as a body also including smoke or splash, 
Cores A and B are not necessarily own cores of a migration body in many cases, and 
had the problem which cannot measure migration of this body correctly in the 
conventional method. 

[0111] On the other hand, since the tip of the migration direction of this migration 
body is always caught, possibility of pursuing the migration body itself is high, and, as 
for the body trace means 109, can measure the migration direction of this body 
correctly. Although it asks for a movement vector by the conventional approach 
immediately after objective trace initiation since the movement vector 1003 which 
should be referred to is not obtained, the body trace means 109 asks for the objective 
migration direction tip by making the average of the movement vector covering this 
movement vector or multiple frame into the reference vector 1003, and measures a 
movement vector. 

[01 12] The above explains actuation in case two or more detection bodies exist based 
on drawing 11 , although it is a method of pursuing in case the number of detection 
bodies is one. 

[0113] Drawing 1 1 (a) is the case where a detection body moves at a low speed, a 



body 1001 and a body 1101 are bodies detected with the present frame, and a body 
1002 is a body detected with the front frame. E is the core of the detection body 1 101 . 
or the core of a circumscription rectangle, and F is the point that the profile of the 
segment developed in the direction of a movement vector 1003 and a body 1101 
crosses. 

[01 14] Since a body is a low speed, the movement vector 1003 called for in the trace 
to a front frame is small, and its dependability of the migration direction is low. Then, 
collating of an inter-frame body makes things with a near distance collate. For 
example, as a candidate whom the detection body 1002 moves with degree frame, 
they are bodies 1001 and 1 101. Although the body which agrees with the direction of a 
movement vector 1003 is 1001, when a movement vector 1003 is small, let matching. 
Vector BE, or Vector DF be the vector of new migration for the minimum body of 
distance, 1 101 [ i.e., ]. 

[01 15] On the other hand, drawing 1 1 (b) is the case where a detection body moves at 
high speed, a body 1001 and a body 1 102 are bodies detected with the present frame, 
and a body 1002 is a body detected with the front frame. G is the intersection of the 
segment developed in the direction of a movement vector 1003 through the core of 
the detection body 1 102, or the core of a circumscription rectangle, and the profile of 
a body 1102. At this time. Vector DG or Vector DC is thought as an inter-frame 
movement vector. 

[0116] Generally the body under high-speed migration cannot change the migration 
direction rapidly. If this is taken into consideration, Vector DC will be chosen as the 
movement vector 1 003 to a front frame as what has a near direction and magnitude, 
therefore it will be judged that the body 1002 of a front frame moved to the body 1001 
with the present frame. 

[01 1 7] An example of the body trace means 109 which carries out the above actuation 
is shown in drawing 12 . 

[0118] The body trace means 109 consists of the circumscription rectangle setting 
means 1 201 , a main coordinate and the tip coordinate measurement means 1 202, the 
movement vector evaluation means 1 203, a movement vector selection means 1 204. a 
main coordinate, a tip coordinate and the movement vector maintenance means 1205. 
and a body coordinate output means 1206. 

[0119] With the circumscription rectangle setting means 1201. the binary picture of 
the detection body selection means 107 is processed, and the circumscription 
rectangle of a detection body is set up. A circumscription rectangle is a rectangle in 
which a body is inscribed. With a main coordinate and the tip coordinate measurement 
means 1202. while searching for the main coordinate of said circumscription rectangle, 
a tip coordinate is measured based on the movement vector to the front frame of 
main coordinate, tip coordinate, and movement vector maintenance means 1205 
maintenance. 



[0120] With the movement vector evaluation means 1203. all possible movement 
vectors are calculated using a main coordinate, a tip coordinate, the main coordinate 
of the circumscription rectangle of a front frame which the movement vector 
maintenance means 1205 holds, a tip coordinate, the main coordinate of the present 
frame, and a tip coordinate. The movement vector selection means 1204 selects a 
suitable movement vector according to the magnitude of the movement vector to a 
front frame which a main coordinate, a tip coordinate, and the movement vector 
maintenance means 1 205 hold, i.e., the rate of a migration body. From the selected 
movement vector, since a movement vector is determined as the main coordinate to 
the present frame, and a tip coordinate, these are held for a main coordinate, a tip 
coordinate, and the movement vector maintenance means 1 205. 
[0121] From the movement vector which the movement vector selection means 1204 
selected, the body coordinate output means 1206 computes the coordinate of the 
migration body in the present frame, and considers it as the output of the body trace 
means 109. It is effective in the ability to store an invasion body in an image, without 
catching consecutive smoke, a consecutive spray, etc., if a camera is moved based on 
this trace result since the head of a travelling direction is caught correctly even when 
pursuing the vessel which raises the flight body which moves while taking out smoke, 
such as a rocket and a missile, by taking the above configuration, and wave splash, and 
navigates. 

[0122] Next, while computing the migration locus of said body by accumulating change 
of the objective coordinate for every frame of the body trace means 109, when moving 
exceeding predetermined migration length, it Judges with an invasion body, the 
information means 1 307 operates, and the invasion body judging means 1 1 0 controls 
the field-angle adjusting device 1 306, and report to a hitcher on or it records [ and / it 
controls image transcription equipment 1 308 and ] an image on videotape. [ controlling 
a camera 1301 ] Even if the hitcher on is not always viewing the monitor by taking the 
above configuration, it is effective in detecting an invasion body and being able to 
record the image of this invasion body. 

[0123] Cameras of the wavelength covering a variety, such as not only the camera of 
a visible wavelength region but a near-infrared camera and a far-infrared camera, are 
sufficient as the TV camera described above. For example, if a far-infrared camera is 
used, Nighttime can carry out monitor actuation, without using a lighting system, and 
has effectiveness with unclear being supervised by the invader. 

[0124] Moreover, if a near-infrared camera is used, while the image similar to a visible 
monochrome camera will be acquired, when a near-infrared LED lighting system is 
used, since it is small, the reinforcement of a visible region is effective in it being 
mental-fatigue-hard to an invader, being related with him. and being able to do. 
[0125] 

[Effect of the Invention] If the monitor object domain whole region is stored in the 



field angle of a television camera according to the first example of this invention, there 
is this effectiveness it is detectable [ an invasion body ] ineffective throughout a 
monitor object domain. And there is effectiveness it is ineffective to it being possible 
to catch this invasion body that moves, without reacting to branches and leaves, the 
reciprocating motion of a flag, and fluctuation of the water surface, if this invasion 
body is detected and reported after some invasion bodies move. 
[0126] According to the second example of this invention, by displaying the analysis 
result of an environmental analysis means, it is easy to grasp a situation of operation 
for a hitcher on, and there is effectiveness it is ineffective to the system which is easy 
to treat. 

[0127] When the second example of this invention is carried out by computer, it is 
effective in an invasion body being always detectable using the calculation speed of 
the newest computer 

[0128] According to the first example of a high speed vessel detection means of the 
image supervisory equipment of this invention, it corresponds to change of the 
amount of fluctuation of a background promptly, and regulating automatically is 
possible and it is effective in the ability of incorrect detection to realize little highly 
sensitive image supervisory equipment. 

[0129] Since according to the second example of a high speed vessel detection means 
of the image supervisory equipment of this invention it succeeds in the optimal 
adjustment for each field even if the intense parts of fluctuation or reflection are in 1 
screen, there is effectiveness which controls incorrect detection without dropping 
detection sensitivity. 

[0130] According to the first example of a silhouette body detection means of the 
image supervisory equipment of this invention, it is effective in the ability to catch, 
without depending on the passing speed for the silhouette-ized invasion body. 
[0131] According to the second example of a silhouette body detection means of the 
image supervisory equipment of this invention, even when a building etc. is in a 
monitor field and these silhouetteHze, it is effective in the ability to catch an invasion 
body without incorrect detection. 

[0132] According to the third example of a silhouette body detection means of the 
image supervisory equipment of this invention, it is effective in the ability to catch an 
invasion body, without carrying out incorrect detection, even if how to be able to do a 
silhouette with migration of the light source changes. 

[0133] According to the first example of the low speed and halt body detection means 
of the image supervisory equipment of this invention, it is effective in few invasion 
bodies of a motion being detectable from fluctuation of a background. 
[0134] According to the second example of the low speed and halt body detection 
means of the image supervisory equipment of this invention, it is effective in an 
invasion body being detectable, without incorrect-detecting these, even if there are a 



building, a rock. etc. which were controlled in the detection field. 
[0135] According to the third example of the low speed and halt body detection means 
of the image supervisory equipment of this invention, it is effective in the ability to 
catch an invasion body, without incorrect-detecting these, even if a building, a rock, 
etc. change with time of day. 

[0136] Since according to the environmental analysis means of the image supervisory 
equipment of this invention an operation situation is displayed while regulating 
automatically is carried out to the processing which suited the present environment 
for a monitor, it is easy to treat for a hitcher on. and effective in also finding faults, 
such as failure, at an early stage moreover, and being easy to respond. 
[0137] It is effective in the ability to store an invasion body in an image, without 
catching consecutive smoke, a consecutive spray, etc., if a camera is moved based on 
this trace result since the head of a travelling direction is correctly caught even when 
pursuing the vessel which raises the flight body which moves while taking out smoke, 
such as a rocket and a missile, and wave splash, and navigates according to the body 
trace means of the image supervisory equipment of this invention. 
[0138] According to the invasion body judging means of the image supervisory 
equipment of this invention, even if the hitcher on is not always viewing the monitor, it 
is effective in detecting an invasion body and being able to record the image of this 
invasion body. 



DESCRIPTION OF DRAWINGS 



[Brief Description of the Drawings] 

[Drawing 1] It is drawing showing the second example of image supervisory equipment 
of this invention. 

[Drawing 2] It is drawing of processing in the case of carrying out the second example 
of image supervisory equipment of this invention by computer. 

[Drawing 3] It is drawing of the first example of the migration body detection means of 
the high speed and usual rate of this invention. 

[Drawing 4] It is drawing showing an example of the amount measurement of 
fluctuation of the amount measurement means of fluctuation of this invention. 
[Drawing 5] It is drawing showing an example of the amount measurement aperture of 
fluctuation of the amount measurement means of fluctuation of this invention. 
[Drawing 6] It is drawing showing an example of measurement nullification of the 
detection invalid field setting means of this invention. 

[Drawing 7] It is drawing showing an example of the silhouette body detection means 
of this invention. 



[Drawing 8] It is drawing showing the low speed of this invention, and an example of a 
halt body detection means. 

[Drawing 9] It is drawing showing an example of processing of an environmental 
analysis means. 

[Drawing 10] It is drawing showing the difference between a trace of the body trace 
means of this invention, and the conventional trace. 

[Drawing 11] It is drawing showing an example of the method of pursuing this invention 
of a body trace means. 

[Drawing 12] It is drawing showing an example of the body trace means of this 
invention. 

[Drawing 13] It is drawing showing an example of the operation gestalt of image 
supervisory equipment of this invention. 
[Description of Notations] 

101 [ — The migration body detection means of a high speed and a usual rate. 105 / 
— A silhouette body detection means. 1 06 / — A low speed and a halt body detection 
means, 107 / — A detection body selection means. 108 / — An environmental 
analysis means, 109 / — A body trace means. 110 / — An invasion body judging 
means. Ill / — Display means. ] — An image input means. 102 — A time series 
image maintenance means. 1 03 — An averaging image creation means. 1 04 
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CO 0 6 1] 03ic*3i,^r> mm^mi oAitm^^m 

tfiij^gs 0 1 i:. m^^xosmmmif^^ms 0 2 
i:, 1^ai«5afflili^^^lS3 0 3 i:. ^ii^mm^ms 0 

4t. ^tiimii^^^mm\^^m3 0 5ti-^^^o ftA 
ffii#b. !i%i<*o«Ati:#t>T^-r5, mi^m^mmm 

CO 0 6 2] iS^7K>^^?Se.<-SmTT'^S^Hi 40 

CO 0 6 3] :Kdi¥Sl 0 4l4c:n*||iK-rS^flK*L 
Tt/^T. S^rBti-iBiJ#fia3 0 1 t±B$|^5lJiB««fiF#IS 
1 0 2cDSi0r7U-A$T'<OSC7U-AtCfett-5S5<' 

CO 0 6 4] jSe^fiOW-SiJO-^JtLT. 04»C^-r 
.fc-5»Cfl5e>^SSiBiJS4 0 17!;S4 0 4*S:ltSo 04 50 
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1 3 0 2 T-S^/-ci¥±<D®«T-^-pT. @ 4 

(b) tifs^' iy-L.]^^<o^miimmm<Dmmr'&:s>o 
CO 0 6 53 tzt^im^<rmc^^m&<o^wim^9Y 

mt^rztbi,cmmmcme€mmwm4 o 1 7bS4 o 4 

^^ttSo S6rfiS!)^4 0 1 i^o»S(iiS©Se>€'<o 
TztbicmmLX^^X. 0 4 (a)«§fr7^-Ai:0 4(b) 

CO 0 6 6] m<om^'^<o:kt\^^^micrji:s>tyu-L. 
{k-rsi:0 5(a)<J;Ot>M^^<oa«(i:*:t<. tct^li 

v-'ttf -fflftrs i:0 5 (a) A t) tll^i'®ffiat±i!>'S: 

10 0 6 71 &.±<Dmm^<b^t>^^J:ioK^ btwfii*?) 
B^fk b fc«^{i jS^tOjg e, if -fillt^ 

<*<DffiiffiA^05(b)© J; o tc:*:# < . iSOSe. 
ii if-fBfkWitCiffiatiiasCc)© J: 3 IC/Jn2 < tS:^o 

CO 0 6 8] -mim»(Dmm^~-o(j:)m^fSLmtitm 

b T, -ffifk!Ki«:©MiW*< -ooaj^affiOW:?? J: 0 :^ 
#(.^ii-a-«-fi|{t:b^v^ffl*At< b, -{i{k!|%<*:«D® 
-o<o@^ISfii©M:^ .k ti 'J^S 1/ ^«-&t±-»t b IT 

tc«-pT. !S<0}Se.r<0:^$StcjSi:Tb#v>fiiO:*:* 

CO 0 6 9] r^jit)-^. i&(Dm<b^t)'^:kt <rj:?> tLt 

^{t:-r?.g|?5i-ferfit%{*i:bT<$tB^ntc< <3S:5„ iS^ 
©ge.f'*^'^^ < i: b#v^ffi{±/h^ < ^oT^co^ 

bT«im$n-^-r<'S:5o 

CO 0 7 0] CCT% S6^«H-«iJ#IS3 0 icr)m;'3ti 
lS€>^filiiiJ^.4 0 1 7!)M4 0 4 (^(^^-'(ifkiKli*®®^ 

5o S5.rfi«SiL^,4 0 17!»M4 0 4A>5.&>!?S^Sb 

T'^So j-x^cn^rserbtu^fiiiiDf^ii-r^o 

C 0 0 7 1] SP. S'A ?) SSPH^ftfig^ia 3 0 2 t,m?h 
1) fc*5U^T*;<^ 1 3 0 2mw<DmwimM^mBEm^ 

mm^m^m i o 2 (ommmm t mzts e r a o stpis 

0 171iS4 0 4rt©jKOffi6r.i:»3t,:^t^iSg^l!l^ 
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[0 0 7 2] mmm&Lniimb€mmmm4 o i 

[0 0 7 3] vjL±(ommic^^x. m^€XK>mmmm 
asef fiSfflJS4 0 1 71jS4 0 4 p^to. soge>s'j-x 

[0 0 7 4] mw^m^ms o 4 {±^3^?ij®fis«it#i5 
1 0 2<Dmmmmtm^^x*)mmmmif^^&3 o 2 

(0»ipil#i:t0j5Ji[M»iii®*f^^U, mS<oLti/-'ffl 

Trffift-rscfcickor. s&r«m«ij^4 0 itijm 

4 0 4 rtOjg^Offi^rj: ») fe:^t*WfiiEi!j*5fel;5gP 

[0 0 7 5] iikmm»mmm'^]^^m3 0 sii-mit 
[0 0 7 6] ^mRzsmnmmfonim^w^m^m 1 0 

40. Sr§gSSflfiJi:UT. ^ 1 <D^Jtc<^IWMS5(l«lSIS^ 
3 0 3 fi^^^JiS^'ffiJ^^S 1 0 ZcomfSim^t, tnM 

[0 0 7 7] $fc> SStJiiLOfeSgP^i-T'fi^^fCl^m 

ta^mi 0 5-eif 3ct*^T-tSo 

[007 8] 06 tc1t*»55!)fS«^^#ia 30 3 Olfift 
CT^r^-To 06(a)fiK«m«W<^lii®T'fet). 6 0 

0 3T'5!ia^i!jnxTj!iPa[¥tSiij^*f^fi£-r5 

[0 0 7 9] K«-9-i'i';i/S»c)!raS¥i^iii«!i:ig«Mlft 
,}; 3 tc 6 0 1 tcm-r 5^1^ 6 0 2 aM< . ^tll^il-O 

[0 0 8 0] m&^mim&^<o/h-s\f^m^ts: 
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T?%{*<^ai¥e3 0 4C05!!,a^#±-r5Ci:t>T-€^o 
[0 0 8 1] J.X±tD«fiK^«gSci:T% -SiffirttcSa 

[0 0 8 2] i^tcv'^l/i-y h!at*J<^im#S 1 0 5<Dm— 
[0 0 8 3] @7tCj3l/^T. '>;l/X-y h*S|<*^da^Sl 

0 Sti, ->;l/x-y htB)g1taj^S7 0 1 i:!|^i*«iai?S 
7 0 2 T'lifiStSn-So l~tSlg5^til¥S7 0 1 ic 

r. iDS¥i^iii»f^fig#S 1 0 3»c*SiiD3S¥J^ffl«i-^ 

[0 0 8 4] HtC. m^cOiBPa[J.;^±om«rtT\ ^?S9"J 
iB»^^© 1 0 2 ©gffH«!%t. 3 — O(0mS<0SiS 

20 li^ai#e 7 0 nc J: ^ v-;l/X -y h!|%)(*:<gM*->>'l'X -y 

h{kbircffiA%i(*:^ffii: bT->;bx-y hmimm^m 1 

0 5 J; D W;'3-rSo lU.±<omiil.^^^ C tX\ ->;Ux-y 

[0 0 8 5] ^tStSH^tCjz-rjTti, K*i«^^«F^»C]l 

X>y hfkb. i^;l/X-y h!|%i*:^ai?g 1 0 5 0^— HAS 
ffi|T-« S/;l/x -y h ft b fc« A1«3f*<i*iK % o T b * 3 o 

^CT-, ->;l/X-y h*!3i*<$m#ei 0 50B-*SSm 

JO m-'mmm(Dmmcmmm»i^^^Si 703 teiasnjai 

[0 0 8 6] ^Midfttc^til-^. 1 0 2*^6, « 

A!f%{*©#Sb*i.^w^^A:'3f m-^mmtm 

i: 3 tcK^H^lSrtoaitfecDv'-'l/X -y hitLrci^cOi}'' 
«iai$n«<DT, c:n*SiPil»i:bTSipi®«f^fi)i# 

157 0 3tc«}$-r5o ^mm^mi^m^^m7 0 4 
*piii^^^^S7 0 3<Dunt^mmmmxmmm<om 
i^^immiAt Lxtiiij-r^o 
[0 0 8 7] ^w.mmmi,cmw'^iii^f^7 0 2 {±i>;i/x 

40 -y hmmkta^^k 7 0 UC <fc 5 5^;bx >y h^t^%f*A^ ?><t 
mM5aitSlie^^¥S7 0 4<D^55(iaUi*^i/^fcfeO«:i' 

ybx-y h{t:bfc%if*i: Lxmtit^o 

[0 0 8 8] &L±<Dm^^t^^^tx\ mmmmp^icm 

[0 0 8 9] bA>b^P^i:i:t.tC;fcll:Q:^<D7ti^,A^^f)j 
^tiS^Sl 0 5©mHllfiggiJtiSr*fi{lfiiiJomtcM»r 
50 [0090] MSrf$WKSfe#l8 7 0 5 ttS 5. *^ bl6Si46 
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0 3ice^6n-5o MSf«#*K«fc. mmmmr?^^ 

S7 0 3{iC<D^,^T'<DWl/X-y h^JgE^tb¥fS7 0 1 

[00 9 1] &L±<om^^m^ctX'. ^m<oi»mcw 

[0 0 9 2] i>:tC ••{fiji&aff±%t*«im#S 10 6" 
*14li*«iai#S i 0 6 hlilSISL. 10 6© 

[0 0 9 3] j8[KO<fc3tC*6^-r^fi!)L.Ti/-Si£^^ 

*iDS¥i^ia«f^fig^a 1 0 3T-^ias-r5fc, »s«d^ 

o # ») i: Lfcfi*i)-^A<3inSo 
[0 0 9 4] 0 6{±COl4«*fflV^T{g 

iST'S^K t L < {iff ± b T -S « Al^li^^^ai-r 5 ¥8 

T% ^F^ffli»5aa?is8 0 1 i:^*t:^m¥e8 ozx-m 
i^^ti^o ^mmivm^ms o i \,t^mm\,cmmm 

nL<o^t>^w^^i^\!&t^^mx\ mm-t^mmn±(D 

n^^nm-^%x^mi\ \:x±<o^mx'^m^K±^< 
itLx'vuw^miat^o 

[0 0 9 5] ^w^^m^ms o 2 a^mm^^m^ma 
0 i<ommi,tzVtiiw^{6.m^rcim±Lx\,^?>mx^w 
mmt LximRzfw±<^wtkiii^$^ 1 0 e A>em;^-r 

[0 0 9 6] mmmmc^-:>xi,i. ^m^mmmp^icm 

Oo ^CT. iSM&tfff±?«J<*<^m#S 1 0 6©Sr|l 
[0 0 9 7] ^ffif&mcJfeSr^, *^-7l 0 2*^5., « 

8 0 3 tmi^t^o mmm^mi^m^^&a 0 4 nmm 
mmv^^^ms 0 3o«it-rsstpiii«t?ajSt!B<D«« 

[0 0 9 8] mmfssbmicn^imiii^ma 0 2 ti^rass 
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#©8 0 4(OM5aj^i^^^V>fcfeO^{g3^BLa'ff±45<D 
[0 0 9 9] iS<oi^-^§|ti:i:feic«ji!i%i©®S>'^^'- 

>imit-t^o ^cT'%ii*«^ta¥Si oBfosHUfifieii 

lim-*S{H5tJ(0«fiKtcHfrNFW^^¥S8 0 smu^tc 
mi&X&^o Mfr^W^^^S8 0 5afee.*>U46^46 

0 3fceAe.n-5c Mff^^AKsi;, mmmmim^ 

©8 0 3«C(D^^^T-O^KIS»5aS#S8 0 1 (Dtiiti 

«iai^s«(is«i:-r5„ iu.±<Dmis.^i^^ctx\ mmt 

[0 10 0] '^icmm^tfi^f^i 0 8(r>W}i'?^m9xm 
20 ^itbL'Srd^efe, ^m^wtmtR-isn^jii}^-:} resworn 

LT, ^afeSl(073*'«^l/^«^t±X7^-y:/2tCjt*s 

[0101] mmTkzfm'^m&<D^m'iiswmiii^m i o 

«^¥«a:l 1 lT'«^-rS (X7^'yy2) o 

1 0 7 A^iib^^At- F© t tfi. ;g)SRt>'ji 

[0 10 2] ilP»¥l^H» 1 0 3 C»JlDS¥i^i®^ 

ztnwii.x^<Dm^m^^&i i u^ia^bfctj-r-s 

(XX -y ^2) o v-yl/i-y Ki^aft^^m^ia 1 0 5T-«l£li 

K^fcOO^^IiJ^H-SiTS (Xx-y^S) o X7--y:/ 

T, f|^SS:<073A^^W^li^{±Xx-y:/4lcJi*. '>^(,^ 
*^|p| C^-g-fiXf- -y r 5 icjityo 
[0 10 3] iy)V:^y h^ii^^tii^mi 0 5X/-rXt}^ 

m^fSii 0 3<ommmmi)'^^mmtirctf>X'. numm^m 
m(ow.m^'nr> tmc. cne.c»tiffi«:^5^#si i i 
T'«5^-r5 (xx-yy4) o imRzfm±mt^^tii^m 

1 0 6T'Siaiu**^e.t. «iait!3<*i:s«?^n*A^oi'c: 

50 5) o Xx-yy5<OU-ai^«4:fee.3&-i;i6glii6T*5l/>/'c 
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CO 1 0 4] {a3i&t/f?±ai*«im#g 1 0 6T'y-<x 

[0 10 5] ti±0«^^^g^(l^tc<^oT. ^^J^^ 

[0 10 6] :^>:ict&f*i&gSi#g 1 0 ^(Dmm^mm^ 

§o 01 0Jca-:5$. !|%f*iiS!i#S 1 0 9O%lf*:aigl^ffi 

• [0 10 7] 0 10 (a)ti«e^coattjia^}4^^*r^T 

feoT. W7\y—L.X^^^\^rcmW\ 0 0 1 hHU>^U- 
AT«iaiL/c*!gft: 1 0 0 2:&l^-iffi®±tcafeT«^L 
Tt^^So 10 0 1 (O^^L^^^h^^tmW 10 0 1 O^l- 
}g^JgOff/D^Ai:g|BL. it^«i 1 0 0 2 co*>L^fe;s>i/> 2a 
1 0 0 2 <ong^^J^O*.D«:8i:af2bTU^So 

[0 1 0 8] ^ 1 0 {b)ti:it^g»«^m#S 1 0 9cO?^f*ji 

0 1 hmy\y-i-x^^i.rcmwi oo2*iwi— iii®± 

[0 10 9] 10 0 1 ^OPf^ufeSlHi^ft: 10 0 1 

^\.Atmw 10 0 2 co^1^}g^^B^of^3,i:^;grBh^lBbTl/^ 

^/c> h;l/l 0 0 3ti:Hf[7l^-i^ST'tOK*^f* 
<Di^Kl^S-r^^ h;VT*feSo Ctiifef*: 10 0 1 
$)^VHi3^g^^JgOJf'vL>A:^>^^<:7 1 0 0 3 tC^^T 
frcfftf U^cl^^i:. *a{tl 00 lOfS^fe^i/^ti^l^g^ 
fB«Dmiq5i:O^Mlft.^%5^LTV^§o Dtiit^flci 0 0 2 
cDPf^L>fe^V^(in}$5SfB04'^i:>B;?)^6^^ h;H 0 0 3 
tC^fTtcmf Lfci^^i^^. ^^f* 1 0 0 2^0fia5$>^l^{i 

[0 1 1 0] lai o<omx^ty\y-h.m(omv^\ oo i 

i: 1 0 0 2ti:HiJf*cDJ:'5tcJg*^x.*o>ttOT'fe^A^ 

ti. m'^\.^^^'^itxmwt\.xi^^^^<Dx. 4^iLx 
CO 1 1 1] -i5. m^mm^mi 0 9\tn\cm^wm 
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T'^So «^<*ii8f#©i 0 9(i. mw<Dimm^m,mt 
#pa-r^#^i&^i? h7i/ 1 0 0 3*^^8n^t>(OT*se3R 

^ 0 0 3 ^ UT. «att:<D8Jf67?[^5feS^#A6T. 

[0 112] J;^±(i:1^WtSli*7b^-O£D^^i0iiSi^ffiT'fe 

[0 1 1 3] 01 1 {^y^ti^mQwrns^x^m-t^m 
'&T'$>oT. 1 0 0 1 h^tei^j^ 110 1 ^tm,y A 

T'«iai;?n/c%«5:T'S!:)> !Klf*l O O 2tiHU7U-AT 

«mi^nfc!i&«:T*fc§o i^t^mai^i i o l<^)4'iL^fe 
^fp]tcmf b/cif«5i^^i*i«^i 1 0 Konnco^^t^^ 

[0 114] mwm&mx&^fcisb. my\y-L.^x<D 

mmx^isb^nrdi^m^^ h;n o o 3 irt^h^ < ^ ^sd 

. ^^a^i* 1 0 0 2 iy-L.xf^mr^m^t u 

Tti%f* 10 0 1^110 1 Tfe^o ^m^^ h;U 1 0 

0 scoyj^t-^wct^vidmt 10 0 1 xs>^f3\ ^W}^ 

^ b;l/l 0 0 3*</J^^l/^J&&(i8gfffi^Og/J^O^^*■r^^ 
"^1101 ^^^/S^^tt. h;UBE*§i/>ti^i^ h;^DF 

[0 115] -73. m 1 1 (b)(i«iUii|%;i*A^iSJiTi»» 
^^«'&rfe-:>T. I^li* 1 0 0 1 t^W 110 2 Ci3El37 

-L.xmm-^tirc^wxh^o Gi^mmvssHii 1 0 2<d 

0 3(Dyj\t]icim£Lrcm^t^w 1 1 0 2cofiii5^(7)3S 

[0 116] -tee^tciSji^Ki^'oi^i^fi.^iaic^giTu 

-L.^X(Ol»m^^V)\^\ 0 0Z\cy5\P\t,±^t£tf^^^\i^ 
}y-L.<r)mW 1 0 0 2 (i3l:7U-AT**fe|{4: 10 0 1 

[0 117] \:x±.(omv^^nmr^mwim^mi o 9 
(D—m^m 1 2 tc^-To 

[0 118] mwim^^i Q9^mi^^mm,^^WLi 

2 0 1^. tpiL^iffi^^5t:fiS^«l^alJ#S 1 2 0 2 

m^t^ V)\^mm^m 1203^. ^m^^ 

1 2 0 4 ^*hmmt9t^mmh^m^^ V)\yu^^ 
e 1 2 0 5 i:. ^wmmti^ti^m 1 2 0 e T«^^n 

[0 119] ^m'fm^'&^WLi 2 0 1 T'ti. ^\mw 
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1 0 7©-fllH»«rS[lSILT^di^{*ODi1.g53g 

CO 1 2 0] ^m^'t' hjvmm^$9^ i z o 3T{±, tp4L>. 
mmtikmmmtf^m^i' 2 0 5<du^ 

^ h;l/?:^TH-j?-r5o ^Si'^iJ^ h;u^#S 1204 

l^^Sl 2 0 5fC«J$t-5o 

[0121] l^ttffi^di:':^^: 1 2 0 eii^Si'^^' 

S^^gl 2 0 40)S^Lfc^I)j^^' 

L^'# «:±lf T*ifT-r S Ufifi^iiSf-r 5 «^T' 

CO 1 2 2] i^KftAiai^W^^IS 1 1 0t±. 

m \ 3 0 6^SiJfflibT;^^-7 1 3 0 1 ^SiJ^lU/i 0, ^ 

a^H 1 3 0 8^wmLxmM^mmLrcK)-r^o u±. 

CO 1 2 3] tM±tCtBL.AcTVA><^«nr«&Sl^(D*P< 

CO 1 2 4] S/-c> 
CO 1 2 5] 
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^Si^^l^T-eA?^{*<Oi$tb A^^ftg t Sjaj^A^fe So 
L*^t>{iA*Sl{*A^t'K €>A>^i!lLrc^JcKftA*SH*^«l 

CO 1 2 6] *^w<o^-^fi(ie9K*n{f. mm^m^ 

CO 1 2 7] *%W<0^-liafie!l*3:^e;L-^fT-^«i 

CO 1 2 8] *^B9oi®#ig«^«<D, is;ai)«sai#e 
CO 1 2 9] :tiftm<ommmm.mm<o. mmmmta^m 

• CO 1 3 0] *MB^©iii«^MSB«o. S'yPx-y 
CO 1 3 1] *^R8tDili«K^^HO, i^yl/x-y h!K)«i 

ir*<fe o T c n e. s^^bx -y h ftf i. h s T- 1. tb^ 

30 Ltc«Afef*^^^5)n§i:v^355(imA^fe?.o 

CO 1 3 2] 2is:%W<oiii{Si£^aSB<o. i/ybx-y h^W 

CO 1 3 3] ^w^<omsmm.m^<o. wseltsw^'i^ 

CO 1 3 4] *%W©iii®ig*i^Bo. ^g3^&t;if±*«i3 

CO 1 3 5] ^nm(om^smwkm<o. {mmf^±m 

CO 1 3 6] *^Bi<DH»gSffi^H©> ^«^^#f#Sfc 
50 J*lSL-»f>-rv>i:(/-'5?!(j«*<fe5o 
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[0 13 7] ^mnnmmmmMMn. ^^}^u^Wi\c 

CO 1 3 8] *^^coiii«KSSSBo. «A!|*{*«^¥ 

[0 4] *^H^«osarfith»J¥go. m^^mwcM 
[0 5] 2^^g«ojf e)rBif-aij#so, se^MtfSJ 

[06] *^W©«^tBf»5*«i^^#®«, W-aiJIRUai 
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[0 7] h!^{*:^aJ¥S©— ^J«r^ 

^■r0-pfe§o 

[0 9 ] mm.i^ig\^WL<o9m<o-m^7r^tmx'^^o 
[010] ^wm(r>w^im^WL<r>^A^t. vm<om 

[011] 1^{*jiB|i¥e<OjiSl!SO-0!l?: 

10 in-tmx'&^o 

[012] *%?§<D!^{*:ji8):*iao. -e<J*s^-ra-e 

[013] H»SM^HtO||fifiS«l<O-0II 
[??^coiK^] 

1 0 1 - mmxts^^. 1 0 2 

1 0 3 • -i!jPSt¥l^iS»<¥^¥Sx 1 0 4 • -iiSj^Rtf iim 
3i*OS^»I#li*^til#®. 1 0 5 - j^^Ux-y M4l<*^ffi 
1 0 6 "{g3ISt>'<f±1^tt:1^ai#K, 10 7-1^ 
20 1 0 8 -^iK»«T#IS, 109 

iiB|!#©. 1 1 0 •••«A1Slf**iJ^#S. 1 1 l-«5^# 
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